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interactions were greatest in classrooms with fewer students. Implications for teacher 
performance assessment and teacher effects on achievement are discussed. 
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Figure 1 . Classroom Learning Assessment Scoring System — Secondary frame- 
work for assessing effective teacher-student Interactions 


Improving the quality of teacher-stu- 
dent interactions within the classroom depends 
upon a solid understanding of the nature of 
effective teaching for adolescents. A number 
of descriptions of classroom environments or 
quality teaching have been put forth in the 
educational and developmental literatures list- 
ing factors likely to be related to student learn- 
ing (e.g., Brophy, 1999; Eccles & Roeser, 
1999; Pressley et al., 2003; Soar & Soar, 
1979). Hamre and Pianta (Hamre & Pianta, 
2010; Hamre, Pianta, Burchinal, & Downer, 
2010) developed an assessment approach that 
organizes features of teacher-student inter- 
actions into three major domains: emotional 
supports, classroom organization, and instruc- 
tional supports. This approach to assessing 
classroom interaction qualities has been tested 
and validated for the grades of prekindergarten 
to five, with evidence supporting this latent 
structure of dimensions and domains across 


grades and across content areas (Hamre et al., 

2010). 

The Classroom Learning Assessment 
Scoring System — Secondary (CLASS-S; Pi- 
anta, Hamre, Hayes, Mintz, & LaParo, 2008) 
was developed for secondary schools as an 
upward extension of previous work. Within 
each domain considered are specific dimen- 
sions of classroom interactions that past re- 
search suggests are likely to be important to 
student learning (see Figure 1). The impor- 
tance of qualities of emotional and relational 
support in the classroom is suggested by both 
attachment and self-determination theories 
(Bowlby, 1969/1982; Connell & Wellborn, 
1991; Pianta, 1999), and is captured via as- 
sessments of the dimensions of positive class- 
room climate, teacher sensitivity, and regard 
for adolescent perspectives. Although the need 
for emotional support of students is perhaps 
more self-evidently important in the lower 
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grades (Ladd, Birch, & Buhs, 1999), adoles- 
cents are highly sensitive to the emotional 
rapport they establish with adults in school 
settings, and the experience of strong connec- 
tions to adults has been consistently linked 
to long-term academic success (Allen, Kuper- 
minc, Philliber, & Herre, 1994; Bell, Allen, 
Hauser, & O’Connor, 1996). The organiza- 
tional support domain encompasses dimen- 
sions of classroom management, productivity, 
and use of varied instructional learning for- 
mats, which facilitate the development of ad- 
olescent self-regulation skills and enhance 
learning (Blair, 2002; Cameron, Connor, & 
Morrison, 2005; Emmer & Stough, 2001; 
Paris & Paris, 2001; Raver, 2004). The in- 
structional support domain reflects teachers’ 
content understanding, focus on analysis and 
problem solving, and quality of feedback, 
which are areas that have long been recog- 
nized to allow students to learn on a deep level 
(Marton & Saljo, 1976; National Research 
Council, 2005). 

The domain approach used by the 
CLASS-S aligns well with constructs from 
several existing theoretical and practical ap- 
proaches. For example, Brophy (1999) de- 
scribed 12 principles of effective teaching en- 
compassing many of the same dimensions as 
the CLASS-S, including supportive classroom 
climate, opportunities to learn, curricular 
alignment, thoughtful discourse, scaffolding 
engagement, and achievement expectations. 
Similarly, Pressley and colleagues (2003) 
draw from their studies of effective teachers 
(e.g., Bogner, Raphael, & Pressley, 2002; 
Wharton-McDonald, Pressley, & Hampston, 
1998) to suggest that effective teaching strat- 
egies can be organized into decisions regard- 
ing motivational atmosphere, classroom man- 
agement, and curriculum and instruction. 
Eccles and Roeser (1999) suggest that school- 
ing is optimally characterized by organiza- 
tional, social, and instructional processes that 
help regulate children and adolescents’ devel- 
opment across cognitive, social-emotional, 
and behavioral domains. A similar approach 
has been taken by McCaslin, Burross, and 
Good (2005) in their examination of class- 
room setting effects on student motivation. 


The CLASS-S draws upon constructs from 
each of these frameworks; however, a key 
challenge raised by all of these theoretical 
frameworks is how best to operationalize and 
assess the constructs they delineate in ongoing 
teacher-student interactions. The CLASS-S 
seeks to meet this challenge by conceptualiz- 
ing and operationalizing these constructs in 
terms of observable, ongoing qualities of 
teacher-student interactions. 

In terms of actual assessment ap- 
proaches, a long line of research suggests the 
value of observation in classrooms as a means 
for capturing the social assets in those settings 
(Brophy & Good, 1986; Pianta & Hamre, 
2009; Shinn & Yoshikawa, 2008; Tseng & 
Seidman, 2007). The CLASS-S builds on a 
rich tradition of approaches to observing in- 
structional environments. The Instructional 
Environment System — II (Ysseldyke & Chris- 
tenson, 1987, 1993) approach outlines an array 
of qualities of instructional support and notes 
the role of positive emotional climate, al- 
though it has not been linked to achievement 
outcomes in typical classroom environments. 
Similarly, the Ecobehavioral Assessment Sys- 
tems Software (Greenwood, Carta, & Dawson, 
2000; Greenwood, Carta, Kamps, & Terry, 
1994), initially developed for use in alterna- 
tive school classrooms, addresses many simi- 
lar constructs to the CLASS-S (Wallace, An- 
derson, Batholomay, & Hupp, 2002; Watson, 
Gable, & Greenwood, 2011). One key distinc- 
tion, however, is that the CLASS-S focuses on 
broad patterns of interaction assessed at a mo- 
lar level, as opposed to the time-sampling and 
counting of discrete behaviors as in the Ecobe- 
havioral Assessment Systems Software. Thus, 
the CLASS-S is in keeping with principles 
of developmental psychology that suggest the 
importance of a focus on the broader organi- 
zation of molar patterns of behavior as a 
means to get at subtle processes not easily 
captured via counts of discrete behaviors 
(Sroufe, Egeland, Carlson, & Collins, 2005), 
such as emerging self-regulation skills and 
resilience. At the younger grades, there is 
emerging evidence that a broad range of class- 
room interaction qualities can be observed and 
linked to student learning gains using this 
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more global yet standardized approach to as- 
sessment (Landry et al., 2006; Pianta, Belsky, 
Vandergrift, Houts, & Morrison, 2008). Sim- 
ilarly, an intervention approach based on the 
CLASS-S framework has demonstrated evi- 
dence of efficacy along with evidence that 
program effects may be at least partially me- 
diated via a single global measure of teacher- 
student interaction qualities from this system 
(Allen, Pianta, Gregory, Mikami, & Lun, 201 1). 

Unfortunately, outcome-based research 
on classroom observation as a predictor of 
actual student achievement is still relatively 
rare in secondary education. A modest amount 
of research beyond the elementary grades has 
successfully observed teaching in specific con- 
tent areas or for specific lessons (Johnson, 
Kahle, & Fargo, 2007; Roth et al., 2006; 
Weiss, Pasley, Smith, Banilower, & Heck, 
2003). Seidel and Shavelson (2007) conducted 
a broader meta-analysis of 125 studies using a 
variety of methodologies to link teacher be- 
havior to student achievement. They did not 
break out the tiny amount of observational 
research from nonobservational research at 
the secondary level, but did note that overall, 
assessments of teaching relied heavily upon 
distal and proxy variables (e.g., survey data) 
of questionable reliability and validity. They 
concluded that effects on secondary student 
academic performance from current ap- 
proaches to measuring teaching quality were 
too small to be of practical significance (e.g., 
effect sizes < 0.04). Thus despite the strong 
theoretical interest in identifying qualities of 
teacher-student interactions linked to student 
achievement, scientific evidence is quite 
sparse regarding our capacity to identify and 
observe the critical features of teacher-student 
interactions that actually predict student learn- 
ing within the secondary school classroom. 
Virtually no evidence exists regarding the ef- 
fectiveness of assessment systems designed to 
capture broad interactional patterns and apply 
across diverse content areas at the secondary 
level. 

One significant potential confound in ef- 
forts to identify qualities of effective teacher- 
student interactions linked to student achieve- 
ment is the likelihood that high-quality inter- 


actions may come more easily among students 
who are already academically motivated and 
successful. Given the likelihood that students 
are to some degree tracked into higher and 
lower achieving groups in secondary schools 
(either explicitly or implicitly), different 
teachers are likely to face students with very 
different characteristics at the start of an aca- 
demic year. End-of-year student test scores 
are highly dependent on preexisting student 
levels of academic proficiency and are typi- 
cally highly correlated with prior year test 
scores. Failure to account for prior year test 
scores would thus misattribute variance in stu- 
dent achievement that would be more directly 
accounted for by background student profi- 
ciencies. In keeping with the growing recog- 
nition of the importance of “value-added” 
approaches to assessing student learning (Ha- 
nushek, Rivkin, Figlio, & Jacob, 2010; Roth- 
stein, 2010), we assess end-of-year test scores 
after first accounting for prior year test scores, 
which we consider to be an indicator of stu- 
dent academic proficiency independent of the 
current classroom environment. 

Purpose 

Some qualities of teacher-student inter- 
actions may primarily reflect student charac- 
teristics as they enter class at the start of the 
year, particularly to the extent that students are 
implicitly or explicitly grouped into higher 
and lower achieving classes. Without aware- 
ness of this possibility, it would be all too easy 
to misattribute the qualities of classroom in- 
teractions to teacher skill levels, rather than 
recognizing that they may primarily reflect the 
academic characteristics of the students they 
are teaching. Thus, to provide the most helpful 
and balanced information to school personnel, 
this study also focused on identifying qualities 
of teacher-student interaction that are linked 
to preexisting student characteristics at the 
beginning of a school year, which are also 
qualities that might otherwise be misattributed 
to teacher skill. By identifying such student- 
driven qualities, this study seeks to provide 
appropriate contextual balance to our emerg- 
ing picture of the role of teacher-student in- 
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teractions: showing not only where these in- 
teractions predict future achievement, but also 
where they may also simply reflect preexisting 
student characteristics, rather than simple 
teacher skill. 

This study addressed three overarching 

goals: 

1. Examine whether a broad, molar, ob- 
servational measure of the quality of 
teacher-student interactions could pre- 
dict achievement in classrooms at the 
secondary level across diverse content 
areas. 

2. To the extent the first goal was met, 
examine the 10 individual dimensions 
of the CLASS-S to try to identify spe- 
cific qualities of teacher-student inter- 
actions linked to future student 
achievement and to do so at a level of 
granularity sufficient to guide future re- 
search on specific teaching practices. 

3. Provide a balanced picture to school 
personnel by assessing not only quali- 
ties of teacher-student interactions that 
predict student performance (after ac- 
counting for prior performance levels), 
but also to identify the extent to which 
certain qualities of teacher-student in- 
teractions appear largely determined by 
student academic skills upon entry into 
the teacher’s classroom. 

In pursuing these goals, we account for 
key contextual and background factors as both 
covariates and potential moderators (e.g., class 
size, and student gender, grade level, and 
family poverty status). Analyses also consid- 
ered whether the predictive efficacy of the 
CLASS-S might be moderated by classroom 
content domain (e.g., math/science vs. Eng- 
lish/social studies). 

Method 

Participants 

Participants were 643 students enrolled 
in 37 classrooms (across 1 1 schools in six 
districts), which served as the control, teach- 
ing-as-usual condition classrooms in a larger 
study of an intervention to improve classroom 


interaction qualities. The larger intervention 
study included 78 classrooms altogether and 
1267 students in Year 1 and is further de- 
scribed in Allen, Pianta, Gregory, Mikami, & 
Lun (2011). Students were eligible for partic- 
ipation if they (a) were in a classroom partic- 
ipating in the control condition of the inter- 
vention study, (b) had parental consent, and 
(c) provided their own informed assent to par- 
ticipate. Teacher informed consent to partici- 
pate in the study was also obtained. Each 
teacher was asked to identify one class that he 
or she considered “challenging” to teach, and 
only one classroom per teacher was assessed 
in the study. Classes averaged 23 students 
(SD = 6.1) in size and an average of 76.4% of 
students participated from each class. Class- 
rooms were approximately equally divided be- 
tween math or science courses ( N = 17), and 
history, social studies, or English courses 
(N = 20). Table 1 presents descriptive infor- 
mation regarding both students and teachers; 
the table indicates that both groups consisted 
of racially and ethnically diverse samples, and 
that the participating teachers reflected a broad 
range of experience levels. 

Measures 

The CLASS-S was the primary source 
of standardized observational data on teacher- 
student interactions in the classroom. The 
pre-K and elementary versions of the CLASS 
are among the most current and widely used 
standardized assessments of social and in- 
structional interactions in classrooms (Burchi- 
nal et al., 2008; Howes et al., 2008; McCaslin 
et al., 2005; Rimm-Kaufman, Curby, Grimm, 
Nathanson, & Brock, 2009). The CLASS-S 
version was modified to capture precisely 
those aspects of classroom interactions that 
we hypothesize to be critical resources for 
educational achievement in adolescence. The 
CLASS-S consists of a set of global 7-point 
rating scales (one rating scale for each dimen- 
sion below) with behaviorally anchored scale 
points providing detailed descriptions of a spe- 
cific dimension of classroom process and its 
scaling from low to high. The CLASS-S scales 
are organized into three overarching domains, 
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Table 1 

Means and Standard Deviations of Primary Measures and 
Demographic Variables 


Mean 

SD 

Student Grade in School 

8.3 

1.5 

Teacher Age 

41.2 

10.6 

Teacher Education Level 

5.4 

1.2 

Number of Years Teaching 

10.8 

10.7 

Class Size 

22.8 

6.1 

Prior Year Achievement Test Score 

461.6 

75.85 

End-of-year Achievement Test Score 

456.9 

74.15 



N 

Student Gender 

Male 

348 


Female 

295 

Student Race/Ethnicity 

Asian 

7 


African-American 

154 


Hispanic 

26 


White 

456 

Students’ Family Poverty Status 

Low-income 

200 


Non-low-income 

420 

Teacher Gender 

Male 

17 


Female 

20 

Teacher Race/Ethnicity 

African-American 

1 


White 

32 


Pacific Islander 

1 


Multi-racial 

3 

Teacher Education Level 

Bachelor’s Degree 

11 


Post Bachelor’s Training 

26 


similar to those reported in factor analyses of 
the elementary version: 

Emotional Support. The Emotional 
Support domain is composited from subscales 
for Positive Climate, reflecting warmth and 
sense of connectedness in classroom; Negative 
Climate, reflecting expressed negativity in 
classroom; Teacher Sensitivity, reflecting re- 
sponsiveness to student academic/emotional 
needs; and Regard for Adolescent Perspec- 
tives, reflecting the teacher’s ability to recog- 
nize and capitalize on student needs for auton- 
omy, active roles, and peer interaction in the 
classroom. 

Classroom Organization. The Class- 
room Organization domain is composited 
from subscales for Behavior Management, re- 


flecting teacher ability to use effective meth- 
ods to encourage desirable behavior and pre- 
vent/redirect misbehavior; Productivity, re- 
flecting teacher ability to manage the 
classroom so as to maximize instructional 
time; and Instructional Learning Formats, re- 
flecting teacher use of varied and interesting 
materials and teaching techniques in an orga- 
nized fashion. 

Instructional Support. The third do- 
main is Instructional Support, which is com- 
posited from subscales for Content Under- 
standing, reflecting teacher presentation of 
content within a broader intellectual frame- 
work; Analysis and Problem Solving, reflect- 
ing emphasis upon engaging students in higher 
order thinking skills; and Quality of Feedback, 
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reflecting provision of contingent feedback de- 
signed to challenge students and expand their 
understanding of a concept. 

Student achievement. Student aca- 
demic achievement was assessed using the 
Standards of Learning (SOL; Commonwealth 
of Virginia, 2005). The SOL is the state-man- 
dated accountability measure for the Com- 
monwealth of Virginia that is administered to 
meet the requirements of No Child Left Be- 
hind. It was first used in 1998, with a 7-year 
period for schools to align their curricula and 
adjust to the testing requirement before the 
school accreditation process began (Common- 
wealth of Virginia, 2005). The SOL program 
has now been in place for almost a decade, 
making it one of the oldest such programs in 
the nation. Students take SOL tests (which 
consist of between 45 and 63 multiple-choice 
questions, depending upon the specific test 
used) at the end of the course in core subjects 
taught by their teacher, and each is standard- 
ized on a 200-600 point scale, with 400 de- 
fined as a passing score with real-world impli- 
cations both for student graduation and school 
accreditation. In terms of validity, the subject 
tests have strong unidimensionality and corre- 
late between .50 and .80 with the Stanford 9 
achievement tests (Hambleton et al., 2000). 
In terms of reliability, high school assess- 
ments had KR-20 coefficients of .87 and .91 
(Hambleton et al., 2000). 

External reviewers have also reviewed 
the tests and found that the “reliability evi- 
dence for the SOL assessments is solid and 
typical of high quality assessments” (Hamble- 
ton et al., 2000, p. 8). Although tests use the 
same scales across subject matter, student 
scores for a given test were adjusted using 
statewide normative data for each test to as- 
sure that scores could be fully equated across 
different tests. We obtained each students’ 
baseline SOL score, which was taken from a 
similar course the year before and each stu- 
dents’ end-of-year SOL score, which was di- 
rectly linked to the instructional content of 
the classrooms under examination (i.e., math 
courses were paired with prior year math 
courses, social studies courses were paired 


with prior year social studies courses, and so 
on). 

Student, teacher, and classroom 
characteristics. School records were used to 
identify students’ gender, race/ethnicity, and 
grade level. Records also indicated whether 
students came from low-income families 
(coded based on student eligibility for free and 
reduced-price lunch, which extends to families 
with incomes up to 185% of federal poverty 
line). Teachers reported on their gender, race/ 
ethnicity, years of experience teaching, and 
education level. Class size was obtained from 
teachers’ enrollment rosters. 

Procedures 

Student SOL data were collected via 
standardized end of course assessments both 
for the study year and for the year prior to the 
study. Classroom observation data were col- 
lected within a limited window between the 
4th and 8th weeks of the school year. Teachers 
were asked to record a typical classroom ses- 
sion and coding was performed based on vid- 
eo-recording of this classroom interaction for 
a teacher, with the camera positioned to cap- 
ture both the teacher as well as a significant 
number of students. Teachers were told to 
record a class session in which they were 
actually teaching (as opposed to giving a test, 
watching a video, and so on). The window of 
observation at the beginning of the school year 
was deliberately selected to minimize the de- 
gree to which qualities of student-teacher in- 
teractions might be influenced by ongoing stu- 
dent engagement and achievement (as op- 
posed to predicting such achievement). 

A team of advanced undergraduate and 
graduate student coders were trained in a two- 
day workshop on the CLASS-S system. Cod- 
ers learned to rate each of the ten specific 
CLASS-S dimensions along a 1-7 scale, with 
a 1 or 2 indicating low quality; 3, 4, or 5 
indicating midrange quality; and 6 or 7 indi- 
cating high quality. At the end of the work- 
shop, each coder passed a reliability test, in 
which they scored within one point of the 
master-coded tapes on 80% of scores, across 
five video segments. The master coders had 
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extensive knowledge of the CLASS-S instru- 
ment. In addition, team members met regu- 
larly during the year to jointly code master 
tapes in order to prevent drift and increase 
coding agreement. The recorded classroom 
session was divided into two 20-min segments 
and each segment was coded independently by 
two trained coders, with a different pair of 
coders used for each of the two segments. 

Scores were averaged across raters. Re- 
liabilities between the two raters for domains, 
assessed via intraclass correlations, using Cic- 
chetti’s (1981) norms for interpreting intra- 
class correlation coefficients, ranged from 
good (.73 for Instructional Support) to excel- 
lent (.77 and .82, for Emotional Support and 
Classroom Organization, respectively). For 
the specific dimensions, with the exception of 
Negative Climate (intraclass correlation coef- 
ficient [ICC] = .50 — in the “fair” range), all 
other dimensions also had ICC’s in the good to 
excellent range (ranging from .64 to .78). 

Analytic Strategy 

This study used a nested design that 
included multiple students within each class- 
room. Initial analyses revealed a significant 
ICC at the classroom level and related design 
effect (.52 and 9.43, respectively). Classrooms 
were also nested within schools, although 
numbers of schools and classrooms within 
them were too small to permit adequate mod- 
eling of school level effects. Hierarchical lin- 
ear modeling (Raudenbush & Bryk, 2002) was 
thus used as the conceptual and analytic 
framework for specifying two-level models 
that examined the association between mea- 
sures of classroom quality and individual-level 
child outcomes (end-of-year achievement test 
scores), after accounting for student grade 
level, gender, family poverty status, and class- 
room size. PROC Mixed in SAS, using re- 
stricted maximum likelihood estimation, was 
used to specify the models derived from the 
following equations (Singer, 1998). In the first 
level of the two-level model (Equation 1), an 
end-of-year test score (T) for a student (i) who 
is in classroom (j ) is a function of the mean 
post-test score for students in this class (0 O .) 


after adjusting for pretest scores (|3 01 ) and 
demographic characteristics of students (P02-4X 
and the error term associated with this esti- 
mated mean {r tj ). 

Y u = 0o/ + 0oi (pretest) 

+ 002 (student gender) 

+ 003 (student grade level) 

+ 004 (student poverty status) + r tj ( 1 ) 

Equation 2 specifies in the second-level 
model that the adjusted mean post-test score 
for students in each classroom ( 0 Oj ) is a func- 
tion of the grand mean post-test score (y^,), 
classroom interaction quality (y 01 ), and class 
size (y 02 ) and the error term associated with 
this estimated mean (m 0 ). 

00; = Too + T01 (quality) 

+ y 02 (class size) + u 0j (2) 

Because all Level 1 coefficients for the 
controls were fixed, the only substitution is for 
0o,, resulting in Equation 3: 

Yij = 7o; + 7oi (quality) + y 02 (class size) 

+ 0oi (pretest) + 0 O2 (student gender) 

+ 0Q3 (student grade level) 

+ 004 (student poverty status) 

+ r, 7 + u 0j (3) 

All Level 1 coefficients aside from 0 O - 
were fixed, meaning that they were not al- 
lowed to vary across classes. For ease of in- 
terpretation, the outcome variable was stan- 
dardized at the grand mean for all analyses. 

We conducted three sets of primary 
analyses. The first examined whether each 
global domain of teacher-student interaction 
quality predicted student achievement, after 
first taking into account student-level and 
classroom-level demographic characteristics. 
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Second, we conducted a fine-grained analysis 
of each dimension within each global domain 
of teacher-student quality as earlier, entering 
student and classroom demographic factors 
first in the model. This identified which spe- 
cific dimensions were significant predictors of 
achievement. Finally, we ran similar analyses 
to assess the extent to which certain observed 
qualities of student-teacher interactions were 
actually predictable from students’ prior levels 
of achievement. 

For each set of these primary analyses, 
we also tested to see whether the findings 
obtained might be moderated by classroom or 
student characteristics. Equations 4 and 5 pro- 
vide examples of the models used for testing 
moderation of the relation of CLASS-S scores 
to achievement via variables at the classroom 
level (Equation 4) and at the student level 
(Equation 5). Equation 4 specifies adding an 
interaction term to the second level model so 
that the adjusted mean post-test score for stu- 
dents in each classroom ( P 0y ) is a function of 
the grand mean post-test score (y^), class- 
room interaction quality (y 0 i). class size (y 02 ), 
the interaction between both Level 2 main 
effects (y 03 ), and the error term associated 
with this estimated mean ( u 0J ). 

Poy = Too + 7oi (quality) + y 02 (class size) 

+ 703 (quality X class size) + u 0j (4) 

Equation 5 instead specifies a cross- 
level interaction between student poverty sta- 
tus (as one example) and teacher-student in- 
teraction quality by combining Equation 1 and 
Level 2 equations, where (3 0j = + y 01 

(quality) + u 0j and (3,,- = y 10 + y n (quality) 
+ My to yield the following: 

Yu = 7 oo + 7 10 (pretest) 

+ 720 (student gender) 

+ 7 30 (student grade level) 

+ 7 40 (student poverty status) + y o: (quality) 


+ 7,, (student poverty status X quality) 

+ (u 0j + u 0J (poverty status) + r tJ ) (5) 

Results 

Preliminary Analyses 

Means and standard deviations for all 
primary variables of interest in the study are 
reported in Table 1. Table 2 presents a matrix 
of the bivariate correlations between the three 
overarching domains of Emotional Support, 
Classroom Organization, and Instructional 
Support along with the specific dimensional 
scales for measures of teacher-student inter- 
action quality. Confirmatory factor analysis, 
using maximum likelihood analysis, supported 
the loading of scales onto the domains as 
presented earlier, with all factors loading 
above 0.4 on the relevant factor (x 2 = 39.60, 
p = .06, confirmatory factor analysis = 0.97, 
root mean square error of approxima- 
tion = 0.07; exact factor loadings are avail- 
able from the authors upon request). As ex- 
pected, prior year achievement test scores 
were substantially correlated with current year 
achievement test scores (r =.69, p < .001). 
All analyses also accounted for a range of 
potentially confounding variables: contextual 
factors, including student grade level, gender, 
and family poverty status, and classroom size. 
Potential moderating effects of these contex- 
tual factors were also examined (via interac- 
tion terms created from centered versions of 
these variables) and yielded no significant in- 
teractions, with the exception of a moderating 
effect of classroom size, discussed further 
later. 

Qualities of Teacher-Student Classroom 
Interactions to Predictors Student 
Achievement 

Table 3 presents results of three hierar- 
chical linear modeling models, one for each of 
the three overarching domains assessing 
teacher-student interaction quality. In these 
models, end-of-year student achievement test 
scores are predicted from baseline scores, 
from student grade in school, gender, and fam- 
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Table 3 

Predicting End-of-year Achievement from Teacher-Student Interaction 
Quality (Covarying Prior Year Achievement and Demographic Factors) 


Predicting End-of-year Achievement Scores From: 


Emotional Support Classroom Organization Instructional Support 



B 

SE 

B 

SE 

B 

SE 

Intercept 

31.30*** 

10.63 

359.8*** 

59.42 

372.6*** 

46.64 

Baseline Achievement Score 
Student Characteristics 

61*** 

.029 

61*** 

.029 

6i*** 

.029 

Student Grade-Level 

5.40 

3.60 

4.50 

3.73 

6.33 

3.77 

Student Gender 

1.90 

3.39 

2.05 

3.39 

1.95 

3.39 

Student Family Poverty Status 

-3.31 

4.32 

-3.23 

4.33 

-3.00 

4.33 

Classroom Size 

-0.06 

1.03 

-.047 

1.07 

-0.56 

1.04 

Interaction Quality Variable 

31.30** 

10.63 

21.65* 

10.35 

25.58** 

10.13 


*** p < .001. ** p s .01. * p < .05. 


ily poverty status (at the child level), and from 
classroom size (at the classroom level), fol- 
lowed by the classroom interaction quality 
variable of interest. The domains of teacher- 
student interactions overlapped sufficiently 
that when analyses examined all three simul- 
taneously as predictors, it was not possible to 
identify significant unique predictive variance 
from any single domain, after accounting for 
the others. Thus analyses were conducted sep- 
arately by domain. 

Results indicate that each of the three 
domains of teacher-student interaction were 
predictive of higher student achievement test 
scores at the end of the year, even after cova- 
rying prior-year scores and relevant student 
and classroom characteristics. Using the ap- 
proach suggested by Peugh (2010), we exam- 
ined the proportional reduction in classroom 
level variance obtained by using this compos- 
ite, relative to the classroom variance remain- 
ing after considering the effects of student 
grade, gender, and family poverty status, and 
classroom size. Results indicated a propor- 
tional reduction in classroom-level variance in 
student outcomes of 12.8%, 5.3%, and 8.9%, 
respectively, from the single assessments of 
emotional, organizational, and instructional 
support. For ease of general interpretation, we 


examined effects not simply in terms of raw 
score equivalents, but in percentile terms (ex- 
amining the change in percentile terms in test 
scores associated with a one standard devia- 
tion increment in an observed domain score). 
The magnitude of the strongest prediction, 
from the Emotional Support domain, indicates 
that, after accounting for other measured vari- 
ables, a student entering with average prior 
test scores (i.e., 50th percentile) in a class that 
was one standard deviation below the mean 
in Emotional Support would on average place 
in the 41st percentile in end-of-year tests; 
whereas an average student with the same 
background characteristics in a class that was 
one standard deviation above the mean in 
Emotional Support would on average place in 
the 59th percentile in end-of-year tests. 

Class size interacted with Emotional 
Support ( B = —4.81, SE = 2.00, p = .02) 
and with Instructional Support ( B = -3.54, 
SE = 1.78, p = .046). These interactions are 
depicted in Figure 2 using standardized scores 
for all variables and plotting lines for class- 
rooms that were one standard deviation above 
and below the mean in class size (reflecting 
class sizes of approximately 29 and 17, re- 
spectively). Figure 2 shows that measured 
Emotional and Instructional Support in the 
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Interaction of Class Size and Emotional Support in Classroom 
Predicting Relative Achievement Gains Over Time 



Classroom Emotional Support 


Interaction of Class Size and Instructional Support in 
Classroom Predicting Relative Achievement Gains Over Time 



Classroom Instructional Support 


Figure 2. Interaction of class size and emotional support in classroom predict- 
ing future student achievement (controlling for baseline achievement) 


classroom was of greatest predictive value for No moderator effects of course content 

student academic achievement in smaller as area were found, which indicates that relations 
compared to larger classrooms. between past and current test scores were not 
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significantly different for math/science versus 
English/social studies courses and that results 
did not significantly differ depending on the 
type of course being taught. (There were also 
no differences in the predictive power of prior 
years’ test scores for math versus science 
courses or English versus social studies 
courses, indicating it was appropriate to col- 
lapse into these two broad categories for ana- 
lytic purposes). 

Specific Effects for Teacher-Student 
Interactions 

For descriptive purposes, analyses next 
followed up on the findings regarding the three 
global domains of teacher-student interaction 
in finer grained detail, by assessing the spe- 
cific dimensions that were coded and compos- 
ited into each construct. As with the domain 
scores discussed earlier, the specific dimen- 
sions overlapped sufficiently that when analy- 
ses examined them simultaneously as predic- 
tors, it was not possible to identify significant 
unique predictive variance from any single 
dimension, after accounting for the others. 
These analyses were conducted separately for 
each dimension and should be interpreted as 
post hoc follow-up tests to the overall results 
noted earlier demonstrating significance at the 
domain level. Results are presented in Table 4 
These results indicate significant predictions 
of achievement from observed positive cli- 
mate, teacher sensitivity, and regard for ado- 
lescent perspectives in the Emotional Support 
domain, instructional learning formats in the 
Classroom Organization domain, and analysis 
and problem solving in the Instructional Sup- 
port domain. 

Classroom Qualities as Predicted by 
Prior Student Levels of Achievement 

Finally, analyses sought to determine 
the extent to which measures of observed 
teacher-student interactions could be pre- 
dicted from levels of student achievement 
prior to entering the class. Such predictions 
can identify which aspects of teacher-student 
interaction may be influenced heavily by stu- 
dent entry characteristics. These results are 


presented in Table 5. Higher quality behavior 
management, instructional learning formats, 
content understanding, and quality of feed- 
back were significantly predicted by students’ 
baseline achievement test scores, along with 
the domain-level scales for Classroom Orga- 
nization and Instructional Support. However, 
no effects of baseline levels of student 
achievement on Emotional Support were ob- 
served. 

Post Hoc Analyses 

To see whether one might utilize these 
findings to construct a measure of observed 
teacher-student interactions that would opti- 
mize prediction (at least in this somewhat 
small sample) on a post hoc basis, we next 
created a composite comprised solely of the 
five individual dimensions of observed inter- 
action that were significantly predictive of 
end-of-year test scores: positive climate, 
teacher sensitivity, regard for adolescent per- 
spectives, instructional learning formats, and 
analysis and problem solving. When consid- 
ered in models identical to those in Table 3, 
this composite yielded a significant B of 30.2 
( SE — 8.91, p < .001). Results indicated 
a 16.3% reduction in unexplained variance at 
the classroom level from this composite mea- 
sure, even after accounting for the other cova- 
riates in the model. Alternatively, the effect 
size of this association is equivalent to a find- 
ing that a student entering with average test 
scores (i.e., 50th percentile) in a classroom 
one standard deviation below the mean on this 
composite reflective of overall quality of 
teacher-student interactions would on average 
place in the 37th percentile in end-of-year 
tests; whereas a student entering with average 
test scores in a class that was one standard 
deviation above the mean on this scale would 
on average place in the 63rd percentile on 
end-of-year tests. 

Discussion 

This study identified specific features of 
teacher-student interactions in the classroom, 
observed using standardized measurements, 
that were directly linked to student achieve- 
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Table 4 

Relation of Dimensional Teacher-Student Quality Interaction Scales to End-of-year Test Scores 
(Covarying Prior Year Achievement and Demographic Factors) 
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ment over the course of an academic year, 
even after accounting for prior levels of stu- 
dent achievement, demographic characteris- 
tics, and classroom size. Moreover, these find- 
ings applied regardless of student grade levels 
and content area of instruction; in short, “good 
teaching” was good regardless of content or 
grade level. These results have implications 
not only for theories regarding the role and 
value of interactions and proximal processes 
in social settings serving youth (Tseng & Seid- 
man, 2007), but also for contemporary policies 
and practices related to the assessment and 
improvement of teacher performance (Weis- 
berg, Sexton, Mulhem, & Keeling, 2009). 

These findings are consistent with theo- 
retically driven expectations regarding the 
mechanisms through which secondary school 
instruction affects adolescents’ learning, as 
operationalized via the CLASS-S observa- 
tions. These results suggest that the “value- 
added” of classroom settings may in part be 
attributable to qualities of teacher-student in- 
teractions. These results also extend similar 
findings obtained in prekindergarten and ele- 
mentary school settings, in which observa- 
tional approaches using the elementary ver- 
sion of the CLASS have been used to predict 
measures of student learning (e.g., Hamre & 
Pianta, 2005; Rimm-Kaufman et al., 2009). 
Collectively, these studies provide empirical 
support for the argument that critical teacher 
behaviors can be measured in a standardized 
observational assessment. 

Although studies of student achieve- 
ment have been important in laying a founda- 
tion for inquiry into classroom effects (Ladd, 
2008; Nye, Konstantopoulos, & Hedges, 
2004; Rivkin, Hanushek, & Kain, 2005), they 
had not yet succeeded in identifying specific 
processes that may lead to student learning 
and positive social adjustment across an array 
of content areas. As a result, the field has 
thus far been left to rely largely upon an atheo- 
retical, post hoc approach as reflected in 
Hanushek’ s (2002) definition of teacher qual- 
ity: “Good teachers are ones who get large 
gains in student achievement for their classes; 
bad teachers are just the opposite” (p. 3). This 
definition, although apt as far as it goes, 


provides only limited guidance to efforts to 
produce effective teaching (Cochran-Smith & 
Zeichner, 2005). The present study extends 
our understanding of the connection between 
specific observed teacher-student interactions 
and student achievement into secondary 
school classrooms and supports the theoretical 
proposition that properties of these interac- 
tions have value for student learning and de- 
velopment regardless of the content being 
taught. 

In the present study, aspects of teacher- 
student interactions reflecting instructional 
support and classroom organization were pre- 
dicted by the baseline level of achievement of 
students in a given class (although these still 
went on to predict achievement after account- 
ing for these baseline levels). In contrast, how- 
ever, features of teachers’ emotional support 
appeared independent of students’ baseline 
levels of achievement. These findings have 
implications for the observation of instruction 
(i.e., teacher oversight) in contexts in which 
value-added achievement test analyses cannot 
be readily conducted. These findings suggest 
that observed levels of instructional support 
and classroom organization, although impor- 
tant in predicting future student achievement, 
are likely to reflect both teacher skill and stu- 
dent background. Thus, to the extent students 
are implicitly or explicitly grouped or tracked 
into higher achieving and lower achieving 
classes, it would be important not to assume 
that observed qualities of instructional support 
and classroom organization were solely a re- 
sult of teacher skills or efforts. Observed emo- 
tional support, in contrast, also predicts future 
student achievement after accounting for base- 
line achievement but appears relatively inde- 
pendent of student background characteristics, 
and thus may be more likely to be determined 
by individual teacher qualities. Notably, there 
is evidence now from experimental studies 
that teachers’ behavior in all three CLASS 
domains can be improved with teacher train- 
ing that targets these interactive behaviors 
via training either through college courses 
(Hamre et al., 2010) or through ongoing, job- 
embedded consultation (Allen, Pianta, Greg- 
ory, Mikami, & Lun, 2011; Brown, Jones, 
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LaRusso, & Aber, 2010; Pianta, Belsky et al., 
2008; Raver et al., 2008). 

With regard to emotional support, at- 
tachment theorists posit that when adults pro- 
vide emotional support and respond contin- 
gently, children develop self-reliance and are 
better able to explore (Ainsworth, Blehar, 
Waters, & Wall, 1978; Bowlby, 1969/1982), 
a premise that has been repeatedly validated 
in school environments (Birch & Ladd, 1998; 
Hamre et al., 2010; Howes, Hamilton, & 
Matheson, 1994). Self-determination theory 
(Connell & Wellborn, 1991; Skinner & Bel- 
mont, 1993) posits that motivation to learn is 
in part related to adults’ support for compe- 
tence, relationships, and autonomy (Roeser, 
Eccles, & Sameroff, 1998). Instructional inter- 
actions have been put in the spotlight in recent 
years as more emphasis has been placed on the 
translation of cognitive science, learning, and 
developmental research to educational envi- 
ronments (Bransford, Brown, & Cocking, 
1999; Carver & Klahr, 2001; National Re- 
search Council, 2005). Teachers who use 
strategies that focus students on higher order 
thinking skills, give consistent, timely, and 
process-oriented feedback, and work to extend 
students language skills, tend to have students 
who achieve more academically (Hamre & 
Pianta, 2005; Justice, Meier, & Walpole, 
2005; Meehan, Hughes, & Cavell, 2003; Tay- 
lor, Pearson, Peterson, & Rodriguez, 2003). 

Emotional support may be particularly 
important in instructional settings serving ad- 
olescents. Unlike in elementary education, in 
which most students can be expected to have a 
disposition toward seeking to please teachers 
and comply with authority, engaging adoles- 
cent students emotionally may be critical to 
maximizing their academic motivation in the 
classroom. Further, as adolescents seek greater 
autonomy with respect to parents, having 
other settings in which they can receive emo- 
tional support from adults may provide a pow- 
erful motivation to engage in those settings 
(National Research Council, 2004). 

That adolescents achieve at higher lev- 
els across a range of content areas in the 
context of more positive classroom interac- 
tions, although not yet well documented in the 


educational literature, is actually quite consis- 
tent with developmental theory. In contrast to 
assessments targeted at specific content areas 
(e.g., seventh-grade math instruction), this as- 
sessment broadly targeted instruction across 
the full range of core secondary instructional 
content areas. Moderator analyses provided no 
evidence that predictions differed in magni- 
tude across different content areas, suggesting 
that the generality of the approach to assessing 
instruction across widely different content ar- 
eas was successful in this instance. 

Follow-up descriptive analyses shed 
light on specific dimensions of teacher-stu- 
dent interaction that were most predictive of 
student outcomes. These analyses were explic- 
itly descriptive and exploratory in nature; 
however, of necessity, the dimensions exam- 
ined contained a degree of redundancy, both 
with the larger domains examined, but also 
with the other dimensions observed. Although 
we present them in terms of conventional sig- 
nificance levels, we recommend they be inter- 
preted with caution, requiring further replica- 
tion. In the Emotional Support domain, teach- 
ers’ ability to establish a positive emotional 
climate (Positive Climate), their sensitivity to 
student needs (Teacher Sensitivity), and their 
structuring of their classroom and lessons in 
ways that recognize adolescents’ needs for a 
sense of autonomy and control, for an active 
role in their learning, and for opportunities for 
peer interaction (Regard for Adolescent Per- 
spectives) were all associated with higher rel- 
ative student achievement, after covarying 
baseline levels of such achievement. Simi- 
larly, use of instructional learning formats that 
encouraged active participation by students 
and that provided variety in classroom ap- 
proaches (Instructional Learning Formats) was 
also predictive of student achievement, as 
were lessons that required high levels of anal- 
ysis and problem solving by students (Analy- 
sis and Problem Solving). 

Overall, the particular constellation of 
interactions that was most linked to future 
achievement seemed to focus upon tailoring a 
classroom experience to be maximally emo- 
tionally and intellectually engaging to the ad- 
olescent. In post hoc analyses, this constella- 
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tion could account for a difference in student 
achievement test performance spanning the 
37th- 63rd percentiles, a magnitude that has 
considerable ramifications for teachers, class- 
rooms, and schools in terms of accountability. 
Stated differently, on the particular tests used, 
the swing in scores reflected in moving from 
an average classroom to one that was one 
standard deviation above the mean score in 
overall teacher-student interaction quality 
would be sufficient in the abstract to reduce 
failure rates on these high-stakes tests from 
17% to 11%. 

Classroom observations have been used 
as measurement tools in educational research 
for more than three decades (Gage & Needels, 
1989). In most studies using observational 
methods, approaches typically focused on spe- 
cific teacher pedagogical behaviors. The pres- 
ent study results and other related findings 
(Pianta, Belsky et al„ 2008) demonstrate the 
predictive utility of a focus on interactions, 
given the fact that they can be assessed in 
secondary classrooms via 40 min of video, and 
that global ratings of interactions, as they 
demonstrate patterns of behavior and response 
over the segment, can be coded reliably and 
account in some part for the value of that 
classroom setting for student learning. Nota- 
bly, two of the domains of teacher-student 
interaction quality that were assessed, emo- 
tional and instructional support, were more 
strongly related to achievement in smaller as 
opposed to larger classrooms. One explanation 
for these findings is that qualities such as 
sensitivity to student needs or provision of 
high-quality feedback to students might have 
the greatest effect when they are concentrated 
among relatively fewer students. Conversely, 
the effect of these factors might be relatively 
diluted in very large classrooms. 

The particular methods for observation 
used in this study also warrant discussion as 
they have implications for the use of standard- 
ized observations as measures of teacher per- 
formance in states and in districts. Results 
were obtained based on observations of just 
40 min of a single classroom session early in 
the school year using global, judgment-based 
standardized ratings of teacher-student inter- 


action. Under these conditions, the CLASS-S 
is likely capturing only a modest portion of the 
true variance in the quality of teacher-student 
interactions that exists across an entire year 
(Mashburn, Downer, Rivers, Brackett, & Mar- 
tinez, 2013). Thus, the estimates of the effects 
of classroom interaction quality in this study, 
although substantial, should be taken not only 
as a likely minimum estimate of the effects of 
the specific qualities observed, but also as an 
indication that stable and reliable between- 
teacher differences in interaction can be ob- 
served in a fairly efficient manner. 

At the same time, it should also be ac- 
knowledged that this was not an experimental 
study, and that even longitudinal analyses of 
end-of-year achievement controlling for base- 
line levels are not logically sufficient to dem- 
onstrate causal relations. It could be, for ex- 
ample, that other unmeasured factors were 
promoting both student achievement and high- 
quality instruction in the classroom. Even if 
this were the case, however, the results of this 
study would still indicate that the domains 
assessed were sensitive proxies of important 
classroom processes related to student 
achievement. Also, as achievement data could 
not be obtained on 24% of students in class- 
rooms (because of a lack of parental consent), 
it remains possible that such additional data 
might have altered study findings, although it 
is not clear whether they would have biased 
findings in any particular direction. Teachers 
were also asked to select one of their more 
challenging classes to teach for this study, and 
thus results should properly be generalized to 
such classrooms. It is also possible that bias 
existed in which classroom session teachers 
selected for video recording, thus introducing 
unmeasured bias into the assessments ob- 
tained. Finally, it was not possible to assess 
effects of classroom nesting at the school 
level, which introduces an additional potential 
source of unmeasured bias into the results. 

In sum, it is striking that given the im- 
portance of classroom settings as vehicles for 
the transmission of knowledge and skill in our 
system of education, that little-to-no popula- 
tion level data exist pertaining to adolescents’ 
exposure to specific practices in the classroom 
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that are (a) known to relate to academic suc- 
cess or failure, (b) desired on the basis of 
certain policies or values, or (c) even hypo- 
thetically expected to relate to outcomes. In 
secondary classrooms there is no current work 
that provides national-level, observational 
data on these environments. The Measures of 
Effective Teaching Study (Bill and Melinda 
Gates Foundation, 2010) will likely produce a 
number of important findings in this regard in 
coming years. The MET study includes obser- 
vations of over 3,000 teachers in Grades 4-9 
and is using several observational protocols. 
Several, like CLASS-S, focused on global in- 
structional process, and some focused specif- 
ically on content. We argue that designing 
standardized observation protocols into cur- 
rent value-added state-standards tests and 
large-scale student assessments could leverage 
not only our understanding of classroom ef- 
fects (Early et al., 2005; National Institute of 
Child Health and Human Development Early 
Child Care Research Network, 2005; Pianta et 
al., 2005; Pianta, La Paro, & Hamre, 2008) but 
also the capacity to systematically produce 
effective teaching. 

Potential Implications for Practitioners 

In the midst of concern about standard- 
ized tests, block versus regular class schedul- 
ing, school size and budgets, this study em- 
phasizes the fundamental importance of the 
emotional quality of the classroom as a key to 
adolescent learning. Although we can think of 
them as “learners,” adolescents are first and 
foremost highly social and emotional beings. 
The role of school psychologists and admin- 
istrators in both supporting this recognition 
and in helping teachers understand and enact it 
is potentially paramount. The elements of a 
positive classroom climate — teacher sensitiv- 
ity to adolescents’ needs, and recognition of 
their desire for peer interaction and for a sense 
of autonomy regarding classroom activities — 
are not simply the niceties in a functional 
classroom, they are key predictors of adoles- 
cent learning, even regarding otherwise “dry” 
subjects such as algebra or geometry. An ad- 
vantage of the CLASS-S is that it provides 


highly specific markers of these qualities, 
which can be used not only by those evaluat- 
ing teacher-student interactions, but also by 
teachers seeking to enhance them. For exam- 
ple, teachers may enhance the positive climate 
of a class by laughing with students, engaging 
them as they enter the room (vs. sitting behind 
a desk at the front of the room), and asking 
about events outside of class at the beginning 
and end of a lesson period. They may give 
students choices (within a prespecified range) 
of ways of approaching learning assignments. 
They may use varied instructional learning 
formats — moving beyond lecturing to a 
largely silent class, for example, to asking 
students to work briefly in small teams, pres- 
ent ideas to the class, and so on — and focus on 
student analysis and problem solving by ask- 
ing “why” questions not simply factual ques- 
tions. All of these elements were part of the 
ratings of interactions linked to greater student 
learning in this study. 

Equally important, for those charged 
with evaluating teachers, this study identified 
qualities of teacher-student interactions that 
may appear to be linked to quality teaching 
because they occur more in high-achieving 
classrooms, but which appear primarily to re- 
flect qualities of students entering the class- 
room than to predict future achievement gains 
of those students. The quality of behavior 
management in a classroom is associated with 
student achievement, for example; however, 
the association is primarily to preexisting lev- 
els of student achievement rather than to fu- 
ture gains in achievement. This is not to say 
that behavior management is unimportant, but 
rather to suggest that great care be used in 
assessing teachers on this quality unless one 
also accounts for the qualities of the students 
being taught. 

Perhaps the most important reason to 
conduct observational assessment of class- 
rooms is for the purposes of professional de- 
velopment. Professional development typi- 
cally occurs in the absence of a direct link to 
actual teaching behavior in classrooms, partic- 
ularly for already-trained and certified teach- 
ers (Caspary, 2002). Systematic classroom ob- 
servation systems provide a standardized ap- 
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proach to measuring and noting teachers’ 
strengths and weaknesses and evaluating 
whether professional development activities 
are actually helping improve the classroom 
interactions responsible for learning. The cur- 
rent study suggests that professional develop- 
ment focused specifically on teachers emo- 
tional, organizational, and instructional inter- 
actions with students may enhance teacher 
effectiveness in ways that have a direct effect 
on student learning (Mashbum, Downer, 
Hamre, Justice, & Pianta, 2010), while clearly 
raising important questions for future research 
to consider. 
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